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ABSTRACT 

The  canonical  dual  formulation  (the  Lagrangian  function)  is  considered. 
No  concavity  is  assumed.  The  existence  of  the  nonlinear  support  to  the 
hypograph  of  the  optimum  value  function  is  proved  under  certain  assumptions. 
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SIGNIFICANCE  AND  EXPLANATION 

In  optimization  problems  which  possess  certain  geometric  properties 
(concavity)  duality  relations  can  be  obtained  which  are  very  useful  in 
bounding  or  determining  the  extremum  of  one  problem  by  the  extremum  of  a 
related  (dual)  problem.  In  the  present  work  useful  duality  relations  are 
obtained  in  the  absence  of  concavity. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


DUALITY  IN  NONCONCAVE  PROGRAMS  USING  TRANSFORMATIONS 


* 

Okitsugu  Fujiwara 


1.  Introduction 

We  shall  be  concerned  throughout  this  paper  with  a  constrained  maximiza¬ 
tion  problem: 

(P)  maximize  {f(x)  subject  to  g(x)  )  b} 

where  f:  Rn  r\  g:  Rn  **•  Rnj  f,g  €  C2;  n  >  a.  Under  the  concavity 
assumption,  the  canonical  dual  problem  which  is  concerned  with  finding  a 
saddle  point  of  the  Lagrangian  function  has  been  extensively  studied  (e.g. 

Geoff rion  [5],  Rockafellar  [8]).  On  the  other  hand,  without  the  concavity 
assumption  the  Lagrangian  function  is  no  longer  an  appropriate  function  for 
the  dual  problem.  Thus  different  types  of  augmented  Lagrangian  functions  were 
Introduced  and  have  been  Intensively  studied  for  both  local  saddle  points 
(e.g.  Arrow,  Gould  and  Howe  [1],  Rockafellar  19],  [10],  Mangasarlan  [7])  and 
global  saddle  points  (Rockafellar  [11]). 

In  this  paper,  with  no  concavity  assumption,  we  will  transform  the  original 
problem  so  that  in  the  transformed  problem  the  Lagrangian  function  takes  an 
adequate  role  for  the  dual  problem.  However,  this  transformed  problem  is  by 
no  means  a  concave  program,  hence  our  approach  is  different  from  the  so-called 
concave  transformability  (e.g.  Avriel  [2J,  Ben-Tal  [3]).  We  will  study  the 
hypograph 

K:  ■  {(y0,y>  *  a"*1  I  y0  <  w(y)> 
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v(y):  -  max  (f(x)  subject  to  g(x)  >  y}  . 

Geometrically  speaking ,  the  existence  of  a  global  saddle  point  of  the 

A 

function  can  be  understood  to  be  the  existence  of  the  linear  support  of  K  at 
(w(b)  ,b) ,  (Figure  1).  Thus  the  concave  program  is  simplified  by  virtue  of  the 
supporting  hyperplane  theorem.  But  in  a  non-concave  program  the  supporting 
hyperplane  theorem  is  no  longer  available  (Figure  2). 


Figure  1  Figure  2 

Our  main  result,  under  certain  conditions,  is  to  construct  the  nonlinear 

A 

support  of  K  at  (w(b),b)  (Theorem  5.1).  Moreover,  it  is  shown  that  this  non¬ 
linear  support  function  becomes  linear  In  the  transformed  space,  and  therefore 
a  global  saddle  point  of  the  dual  problem  in  the  transformed  space  gives  a 
solution  to  the  original  problem  (Theorem  7.4),  (Figure  3). 


Figure  3 
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2*  Definitions  and  Notation 
Let  us  denote 

$(u):  -  max  (f(x)  +  uT(g(x)  -  b)> 
x«Rn 

K:  -  {(yo,y)6Rarfl  I  (y0,y)  <  (f(x),g(x)) 
for  some  x«Rn) 


Definition  (efficient  point) 

(yo»y)«K  is  efficient  with  respect  to  SCI:  -  {1,2 . m),  if  (z0»s)6K, 

(ZQ»ZS)  >  (yo,ys)  —4  (z0**g)  -  (y0,ys)  where  yg  (or  zg)  is  the  projection  of 

Is  I  d 

y  (or  z)  to  R1  1 . 

As  a  particular  case,  (yQ,y)eK  is  efficient  with  respect  to  I  if  and  only  if 
K  {(yo>y)  +  R^4"1)  ■  {(yQ>y)}.  Let  e(S)  denote  the  set  of  all  efficient 
points  with  respect  to  S,  let  eff(K):  -  U  e(S)  and  let  eff(X):  -  {x€Rn| 

SSI 

(f(x),g(x))  eff(K)}.  The  following  statements  which  are  easily  proved 
explain  why  we  are  interested  in  efficient  points. 

£  £ 

(a)  _If  x  is  a  unique  solution  of  (P),  then  (f(x  ),g(x  ))  €  e(I)  and 

hence  (P)  is  equivalent  to 

max  (f(x)  subject  to  g(x)  )  b} 
eff(X) 

(b)  If  x  is  a  solution  of  $(u),  then  (f(x),g(x))  6  e(S)  where 
S:  ■  {i  j  ^  >  o),  and  hence 


$(u)  •  max 


{f(x)  +  uT(g(x)  -  b)} 


! 


‘  A 


Defialtloa  (Mors*  Program) 

(P)  is  called  a  Morse  program  if  for  any  local  mini  nun  point  x  of  (P)  with 
J:  ■  {j|gj(x)  ■  bj),  the  following  conditions  are  satisfied: 

(CQ):  {Vgj (x)  j  jfcJ}  are  linearly  independent 

(SCS):  there  exists  a  unique  u  a  0  such  that 


Vf(x)  +  £  u.Vg.(x)  -  0 
1  3  1 


yOHiU. 

tB 

(SOSC):  £(x):  ■  V2f(x)  +  £  u.V2g.(x)  is  negative  definite  on 

1  3  3 

Kernel  Vgj(x)T,  where  gj(x)  -  (gj (x))j§J. 

Sp  ingam  and  Sockafellar  [14]  showed  that  if  ffcC2  and  &<?  than  for  almost 
every  <s,t)  6  Rn  x  r® 


nax  {f(x)  -  s  X  subject  to  g(x)  >  b+t>  is  a  Morse  program* 


Note  that  this  perturbation  of  the  objective  function  enables  us  to  have  at 
most  one  global  solution  (Fujiwara  [4]).  Therefore  under  the  sane  assumption. 


we  can  almost  always  expect  that  (P)  is  a  Morse  program  with  a  unique  solution. 


Definition  (total  uniqueness) 


(P)  is  totally  unlqua  if  (Pg)  has  at  most  one  global  solution  for  every 
S  £  I,  where 


A  topological  approach  to  this  arguosnt  was  studied  by  Fujiwara  £4J. 


•  "'f •>  rV. 


■.it 
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(Pg):  max  {f(x)  subject  to  gg(x)  *  bg} 

Note  that  if  f  t  C1  and  g  6  Cn  then  almost  always  (P)  is  expected  to  be 
totally  unique,  moreover  (Pg)  is  expected  to  be  a  Morse  program  for  all  SCI* 

A  it 

Let  x  be  a  local  minimum  point  of  both  (P)  and  (PT)  where  J  ■  {j|g.(x  ) 

J  3 

*  b.}*  Suppose  (P)  and  (P.)  are  Morse  programs,  and  let  u  be  the  Lagrange 

J  "  it  it 

multiplier  of  x*.  Then  since  ^  A  is  nonsingular,  by  the 

UjCxV  0  ) 

implicit  function  theorem  there  exist  C1  functions  x(.)  and  Uj(.)  from  a 
neighborhood  N(b^)  in  to,  respectively,  R°  and  R^t  such  that  (x(b^), 
Uj(bj))  -  (x*,u*),  and  for  any  yj  £  N(bj) ,Vf (x(yj>)  +  Zu.(yj)  Vgj(x(yj))  -  0 
and  8j(3c(yj))  ■  yj.  Moreover,  we  have 

(2.x)  atuVxtbj)1  +  VgjCxVujCbj)  -  o 

(2.2)  Vgj(x*)T  Vx(bj)T  .  I(j| 

Note  that  we  can  obtain  that  for  any  y^€N(bj) 

(2.3)  Vf (x(y j))  -  -  Uj(yj) 

3.  Nonlinear  Support  Functions 

In  this  section  we  will  define  and  study  a  parametrized  family  of  functions 
which  will  be  used  as  the  support  functions  of  K.  Throughout  this  paper,  a 
following  assumption  is  made. 

(Al) :  (P)  is  a  totally  unique  Morse  program  with  a  unique  global 

*  * 
solution  x  and  its  associated  Lagrange  multiplier  u  . 


I 
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We  have  that 


(3.7) 


f  (y.#y)  ♦  »«x  (b.)  •  ala  {y  / b .}  as  q  ■*> 
q  °  j  3  j  x/  1 


as  q  0 


C1  /  i 

(3.8)  Vyo*7)  *  *  bj  n  (yl / bi>  as  q  -*»  0 

Jo  Jo 

a  *  I*  * 

where  Jq:  -  JU{0}  c°j  -  UjbW  I  u^b^  (1-0,1,...,  m). 

Moreover,  the  convergence  (3.7)  Is  uniform  on  any  compact  set  of  RtT.  . 


w*>  -  (!<vr/ivri) 

'  1i<“jkj/s,Cbk>  b’}  q '  {£<u*bi/ ouk\)(!'i/bi)’,) 


The  first  term  +  mas  {b4}  as  q  ■*  *  by  (3.4),  and  the  second  term  +  min  {y^b,} 


as  q  -*•  •  by  (3.3). 


By  Dlni’s  Theorem  ,  the  second  convergence  is  uniform  on  any  compact 


set.  Therefore,  by  the  nest  lemma  which  is  easily  verified,  the  convergence 


Dinl's  Theorem  If  a  sequence  of  continuous  functions,  defined  on  a  compact 
metric  space,  converges  pointwlse  to  a  continuous  function  mono tonl cally , 
then  the  convergence  is  uniform. 


(3.7)  is  uniform  on  any  compact  set  of  .  We  also  have  that  by  (3.3)  the 


first  term  -*>  tt  b  ,j  as  q  +  0  and  the  second  term 


J  V‘11  1 


as  q  -*■  0. 


Hence,  (3.8)  is  obtained 


Lemma  3.9  Let  {h  },  h  be  real  valued  continuous  functions  on  a  compact  set 


D  is  R  for  some  y  >  1.  Let  {a  },  a  be  real  numbers  such  that  a 
— “  — — — —  "■  n  " 


Remark  By  Proposition  3.6  the  behavior  of  the  Indifference  curves  evaluated 
at  (yQ,y  ),  according  to  the  increase  of  q  from  -1  to  -h»,  is  illustrated  in 
Figure  6.  v 


4.  Local  Support  Theorem 


Figure  6 


In  this  section,  under  the  certain  assumptions,  we  will  show  that  the 
parametrized  family  of  functions  {F  }  locally  supports  K  at  (w(b),b)  for 
sufficiently  large  q.  Throughout  this  section,  in  addition  to  the  assumption 
(Al) ,  the  following  assumptions  are  made: 
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A  *  * 

(A2):  (yQ,y  ):  »  (£(x  ),  b)  la  efficient  with  respect  to 

J:  -  (ijg^**)  • 

(A3):  aff(K)  is  compact 

(A4):  Wj(yj)  -  £(x(yj))  in  a  neighborhood  of  where  w^Cy^) :  - 

max  (f(x)  subject  to  gj(x)  )  y ..}  and  x(.)  is  the  Implicit  function  defined  at 
the  end  of  section  2. 


We  will  prove  the  following  result , 


Theorem  4.1 


Under  the  assumptions  (Al)  ~  (A4)f  a  program 

(4.2)  max  <y„.yT)  subject  to  wT(yT)  >  yJ 
|j  |  H  O  J  J  J  o 


attains  a  strict  local  maximum  at  (yQ*yj)  for  sufficiently  large  q  >  -1,  where 
-a  "1/q 

P  (y_.y.)  *  (Z  c.y/)  and  J  :  ■  JU{0},  In  other  words,  there  exists 
qoj  ii  o  ■  . .  1  . .  ■■  . . .  ■  "  ■  ■  1  • 

o 

*  * 

qQ  >  -1  and  for  any  q  >  qQ  there  exists  an  open  neighborhood  U  of  \yo»Jy 


R  ^  such  that  for  any  (yQ*yj)*  U  H  Uyo»yj)$  R  wj^yj^  >  ve  have 


Fq(yo'yJ)  <  Fq<VyJ> 


*  * 
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To  prove  this  theorem  we  need  some  preliminary  results  and  we  start  to  prove  the 
following  lemma. 

Lemma  4.3 

£  If  it 

If  (yQ,y  )  is  efficient  with  respect  to  J,  then  x  is  also  a  unique  global 
solution  of  (Pj) . 

proof 

*  * 

It  suffices  to  show  that  if  f(x)  *  f(x  )  and  gjOc)  *  bJt  then  x  ■  x  . 

Since  (f(x),  gj(x))  >  (f(x*),  bj)  -  (y*,y*)  (y*,y*)  €  e(J).  w«  have  that 

(f(x)»  gj(x))  ■  (y*,y*).  Since  (P^)  is  totally  unique,  a  solution  x  of  (Pj) 

* 

must  be  x  . 

QBD 

Note  that  we  have  obtained  VjO>j)  *  w(b). 

For  computational  convenience,  instead  of  (4.2)  we  consider  a  program 


(4.4) 


max  {G(y,y)  subject  to  w  (y.)  *  y  } 
ij  |  q  o  J  J  J  o 

R  ° 

R++ 


where  G  (y  ,y_)  ■  log  F  (y  ,yx);  and  we  assume  that  J  “  (1,2,...,  Jt).  Since 
q  o  J  q  o  J 

eff(K)  is  compact  by  (A3),  we  can  translate  all  coordinates  so  that  we  have 
that  all  y^  >  0  (1*0,1,...,  m)  in  a  neighborhood  of  eff(K). 


Proposition  4,5 
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proof 


Let  L(y  .yT,v)  be  the  Lagrangian  function  of  (4.4).  Then  by  (A4) 

O  J 


and  (2.3)t7L(yo,yJ,v)  -  VGq(yo,yJ)  +  vV^yj)  -  yQ),  namely  -  Cj/j*"1. 

a  _  -1 

(ociyi  >  “  ^jCyj)  for  J-0,1,...,  i.  (recall  that  uQ  ■  1).  Hence  the  Kuhn- 

Tucker  condition  becomes 


VUJ(yJ)  "  cjyjq"1,(oCiy?) 


-1 


Solving  these  equations  at  (y*,y*) ,  ve  obtain 

o  J 


C*^) 


-1 


m 


Fq  la  a  concave  function  and  log(.)  is  a  strictly  increasing  concave 
function,  hence  Gq  is  a  concave  function  for  q  )  *1,  Then  the  Hessian  of  Gq, 
V2Gq  is  negative  semideflnlte  on  Rn.  Restricting  V2Gq  on  a  subspace  we  have. 

Lemma  4.6 

it  if  T 

V2Gq(yo,yj)  is  negative  definite  on  Ker  V(wJ(yJ)  -  yQ)  for  any  q  >  -1. 


proof 


Note  that  we  have 


32G 


+  q 


/ 3G  \J 

k) 


if  i  f  J 


if  i  -  J 


and  hance 


3yi8!ri 


*2  *  * 
qv 


.  .  -i  a  a  *  * 

-(q+l)b1  V  +  qv  u± 


if  if  J 


if  i  -  j 


a.  * 


Since  ^(WjCyj)  -  y°)  -  -(1,  Uj),  we  have  that  a  +  0  €  Kar  ^(wj(yj)  “  7Q 

1  * 

if  and  only  if  a  »  -  Zu.s  .  This  implies  that  a  +  0  4>4aT  i  0  because 
°  1  J  J  J 

*  A 


Uj  >  0  for  j«l,...,  l.  Thus  we  have  that 


•^G  <y*,y*)s  -  Z  a  s 

q  °  J  i,j  1  3 


3yi3yj 


j.m 

32G  32G 

+  s2  . .  A  +  £  s2 - 3. 

°.ayj  J>i  J  3yj 


-  (*) 


First  term  -  2{  Z  (-  Z  M  )s  qv*  u*}  -  -2qv*2(  Z  u*s.) 

Ol  kii  K  K  J  J  J  J 


j*l  k>l  J 

ft  H 

Second  term  ■  qv  Z  uu,  s.s, 

J  k  J  * 

j,k>i 


Third  term  -  qv*  (  £  u*s  )2  -  (q+l)b"1v*(  Z  u*s.)2 

J>1  J  i  0  J>1  J  i 

Fourth  term  -  qv*  Z  (u*s,)2  -  (q+l)v*(  Z  bT^s?) 

i>l  33  j>l  3  J  3 


Hence  (*)  -  -(q+l)v  {b'/C  Z  u  a  )2  +  Z  b'^s?}  <  0 

°  J>1  J  J  J>1  J  J  j 

for  a  +  0  and  for  q  >  -1. 


IJ  j4» 
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j  V  ->.-8 -V’  V.' •  WpHSpni 


Thu  we  have 


ETA(q)B  -  -(q+l)v*D 


*  *  * 

Note  Chat  Kar  ?(Wj(yj)  -  yQ)  -  la  E 


Laaaa  4.10 


Let  d^, ,00,  d^  be  eigenvalues  of  D,  then  we  have  that  all  d^O 

A  A  t 

(1"1,...,  i)  and  -(q+1) v  -(q+l)v  d^  are  eigenvalues  of  E  A(q)E. 


>roof 


A(q)  la  negative  definite  on  la  E 


(by  Lena  4.6) 


BTA(q)E  la  negative  definite  on  R4 


D  la  positive  definite  on  R 


(by  Lena  4.9) 


The  last  assertion  Is  obvious  by  Lemma  4.9. 


Let  F  be  an  orthogonal  matrix  such  that 


(4.11) 


Then  ve  have 


PT(ETA(q)E)P 


-(q+l)v  d^ 


QED 


-(q+l)v  d.  /  . 


Lena  4.12 


T  T  £ 

P  E  (A(q)  +  B)EP  is  negative  definite  on  R  for  sufficiently  large  q>»l. 


! 


'•V  $'  fA  .  - -  : 


Let  A  -  (a^)  "  PTETBEP,  then  by  (4.10)  we  have 


-<q+l)v  dx  +  «u  a^  ....  ®u 


PTET(A(q)4*)EP  - 


-<«*>"  Vu/- 


Pick  up  a  sufficiently  large  q  that  saCleflas 


(4.13) 


-(q+l)v  dA  +  a±i  <  0 


for  ±»1, % 


(4.14) 


oin  |  -(q+l)v*d1  +  *u  |  >  max  |a  J  .  (l2-f) 


Thus  for  any  a  +  0  €  R*  with  |s  |  *  max  Js  j  and  for  any  q  >  q,  we  have  that 

r  i  1 

8TPTET(A(q)+B)  EPa  -  E{-(q+l)v*d  +a  .  )s2  +  l  a  a  a 

1  i  11  1  4^k  Jh  i  k 


<  {-(q+l)v*d  +a  }a2  +  aax|a  v| . (l2-i)s2  <  0 
r  rr  r  J*k  r 


by  (4.13)  and  (4.14). 


Then  Proposition  4.7  follows  immediately.  By  Propositions  4.5  and  4.7, 
Theorem  4.1  follows  since  (y*,y*)  satisfies  the  second  order  sufficiency 

o  J 

conditions  for  the  local  optimality  of  (4.4). 


t 
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5.  Global  Support  Theorem 


In  this  section,  we  will  show  that  {F  }  supports  eff(K)  at  (y  ,y  ) 

<1  O 

for  sufficiently  large  q.  The  following  assumption  is  made  In  this  section: 


(AX):  In  Theorem  4.1,  we  assume  U  ■  U  for  all  q  >  q  . 

q  o 

Then  the  global  support  theorem  will  be 


Theorem  5.1  (Global  Support) 


Under  the  assumptions  (Al)  „  (A4)  and  (AX),  for  sufficiently  large  q  >  -1 
and  for  any  (yQ,y)  #  ef f  (K) ,  we  have  Fq(yo,y)  C  Fq^o»F*)  where  equality  holds 
onizjLf  (yo,yj)  -  (y*.y*)« 


4)  *  a 

proof  We  separate  this  proof  into  two  parts  :  a  neighborhood  V  of  (yQ»y  ) 

and  outside  this  neighborhood,  eff(R)  -  V  . 


(1)  V 


hVJ 


Let  V:  -  UXR^  v  «{(yo,y)  |w(y)  >  yj  . 


(y^.y')*  v— *  wj(y})  *  w(y')  *  y^ 


(y;,y;)6  u  n  {(y0,yj>  I 


wj(yj}  *  yo} 


Fq(yo*yJ)  «  Fq(yo»yJ>  by  Tbeoreffl  4*1  — ►  Fq(yo»y’) 


4  Fq(yo,y  )  and  equality  holds  only  if  (y^,yj)  -  (yQ»yj)*  Since  V  does  not 
depend  on  q  >  q#,  Fq  supports  eff(K)  O  V  at  (y*,y*)  for  q  )  qQ. 


(2)  eff(K)  -  UXR, 


-  eff(K)  -  V 


A) 

This  idea  of  resolving  the  global  support  theorem  into  a  local  and  nonlocal 
components,  when  the  set  in  question  is  compact,  is  due  to  Westhoff  [15] . 


Since  (y  ,y  ) €  e(J),  min{y./b.}<  min  {y./b.}  ■  1  on  K  and  equality  holds 

0  J  1  1  J  1 

o  o 

only  If  (yQ.yj)  -  (y0*yj)‘  Became  nln{y1/bi>  »  1  — >  y±  »  bt  -  y±  for  ell 

Jo 

14  =—*  (yo,yj)  -  (y*,y*). 


Since  {(yo,y)fe  K  |  (yo,yj)  ■  (y**yj))^  v»  w«  bava  that 


(5.2) 


min  (y^bj}  <  aln  {y^/b^} 


on  e  compact  eat  eff(K)  -  V  . 


Let  hq(yQ,y):  "  Bq(yo«y)  -  yq(y*.y*)  «nd  h(yo,y)c  -  aax{bj}. (mlnCy^/b^)  - 

Jo  Jo 


minfaj/bj}).  Then  h  — *■  h  unifomly  on  eff(K)  -  V  by  Proposition  3.6,  and  we 


we 


have  that  h  <  0  on  eff(K)  -  V  by  (S.2).  Therefore,  by  the  following  lemma, 

m 


have  that  hq  <  0  on  eff(K)  -  V  for  sufficiently  large  q 


Lemma  5.3  Let  {hq}  and  h  be  real-valued  continuous  functions  on  a  compact 

If 

set  D  In  &  for  some  It  H.  If  hq  converges  uniformly  to  h  and  if  h(x)  <  0 
for  all  x  €  D,  then  there  exists  q^  such  that  for  any  q  *  q^  and  for  any  x  4  O, 
we  have  h  (x)  <  0. 


proof  Suppose  not,  then  for  any  k  t  1,  there  exists  q^  >  k  and  x^6  D  such 

that  h  (x. )  >  0.  Since  D  is  conpect,  there  exists  a  converging  subsequence 
qk  * 

of  {x^}.  For  no rational  convenience  let  us  as sums  x^  ♦  xq6  D.  By  the  conti¬ 
nuity  of  h  at  xQ  and  by  the  uniform  convergence  of  {hq},  we  have  that  for  any 
e  >  0  there  exists  n(e)  such  that  for  any  k  >  n(e)  (Mx^)  -  h(xQ)|< 

|hq  (xk)  -  h(x^) J<  -  hold.  Then  for  k  >  n(e),  |hq  (xfc)  -  h(xo)|  4 
It  " 


and 
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|hq  (x^)  -  h(xk)|  +  IM^)  -  h(xQ)  |<  e.  This  implies  that  hq  (x^)  <  0  for 
sufficiently  large  k,  which  contradicts  the  choice  of  {q^}  and  {x^}. 


6.  Transformation 


In  this  section  we  define  a  transformation  which  is  coordinate  independent 

and  strictly  Increasing.  It  is  shown  that  by  this  transformation  the  functions 

{F  >  .  _  are  transformed  to  be  linear, 
q  q>u 

For  q  >  0  and  y^  >  0  (i«0,l,...,  m) ,  we  define  a  transformation  used  by 
Scarf  [13]  by 


y  s  »  1  -  y“q 
i  7i 


for  i«Ofl, .  * . «  m.  We  denote  the  transformed  spaces  of  eff(K)  and  by 
ef£(K)  and  Let  us  define  functions  {F^J^q  defined  on  R^1  by 


Vvy):  -  1  -  Fq<vy)~q 

v  v  %  n 


Then  we  have  that 


F  (y0.y)  - 

V1  *v  t\j 


m  -1/q  _”q 

1  -  [  <5Vi’>  ] 


■ 1  -  svr 


- 


since  Ec.  ■  1 
o  1 


'ocI^l 
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This  shows  that  for  any  q  >  0,  a  nonlinear  function  F^  is  transformed  to  a 
linear  function  F  .  Since  this  transformation  is  strictly  increasing  for  q  >  0, 

it  it 

wa  have  that  F  supports  eff(K)  at  (y  ,y  )  if  and  only  if  F  supports  eff(K) 

*  *  q  °  * 
at  (y  ,y  )  (see  Figure  3). 

7.  Global  Duality  Theorem 

0 

In  this  section  we  prove  the  strong  duality  theorem  of  the  canonical  dual 
formulation  In  the  transformed  space.  First  of  all  a  sufficient  condition  for 
the  strong  duality  theorem  is  discussed. 

Leaaa  7.1 

If  Is  a  solution  of  <Ku*)  satisfying 

(7.2)  8(*u*)  >  b 

(7.3)  u*T(g(*u*)  -  b)  -  0 

then  <Ku*)  -  w(b)  -  f(*u*). 

proof  Let  x v  be  a  solution  of  p(v)  for  v  »  0.  Then  ve  have  that 
♦(v)  -  <Ku*)  -  f(xy)  +  vT(g(xv)  -  b)  -  f(xu*)  -  u*T(g(xu*)  -  b) 

*  £<V)  +  vT (g(xu*)  "b)  "  £(XU*)  ■  u*T(8(V)  ■  b) 

* 

*  (V  -  u*)T(g(xu^)  -  b) 

-  vT(g(x)  -  b)  by  (7.2) 

u 

*  0  by  (7.1)  and  v  >  0. 


If  <^(v)  has  no  solution  for  soaa  v  >  0,  than  thare  exists  xy  such  that 
<Kv)  >  *(xy)  +  vT(g(j^)  -  b)  *  f(^*)  ♦  vT(8<*u*)  "  b>* 

Hence  in  this  case  we  still  have  $(v)  *  $*u*).  Therefore  we  obtain 


4»(u  )  -  min  $(v). 
v>0 

For  any  x  £  Rn  satisfying  g(x)  >  b,  we  have  that 


£<V)  "  f  (xu *>  +  u  “  b) 


<Ku*) 


by  (7.3) 


*  f(x)  +  u  (g(x)  -  b) 


*  f(x) 


since  u  3>  0,  g(x)  )  b. 


Therefore  w(b)  »  *  $(u  ) 


Now  we  state  the  main  theorem. 


Theorem  7.4  (Global  Duality) 


Onder  the  assumptions  (Al)  ~  (A4)  and  (AX) ,  we  have 

f(x*)  *  min  max  (f(x)  +  uT(g(x)  -  b)} 
u*0  eff(X)  'v  'v  <v 

for  sufficiently  large  q,  where  f(x)  -  1  -  f(x)”q,  g.(x)  ■ 

\  <\r 

b4  •  1  -  b”*1  for  x  €  eff(X)  and  for  m. 


1  -  8^*)  \ 


-■  futi. 


•  «-  -  is-.  ■Svsi*, 
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proof 


Fq(y*,y*)  >  Fq(yc,y) 

F.<y*,y*>  >  F<yc.y) 

m  *  a 

§c<i  * 

Eu*bq+1y*  >  ”u*bq+1y 

oTi  'i  oil  'i 

'V  % 

bq+1f (x*)  +  Eu*b^+1 g±(x*)  »  bq+1f(x)  +  Eu*bj+^g1(x) 

*\»  1  *\*  'V*  *u 

*  *  *  4+1 

f(x  )  a  f(x)  +  2u.(b./b  )  (g,(x)  -  b.) 

*  %  i  1  1  °  'U1  ,v1 


on  eff(K) 


on  eff(K) 
% 

on  eff(K) 
% 

on  ef£(K) 
% 


on  ef£(X) 
on  eff(X) 


Let  $(u)  ■  max  {f(x)  +  u  (g(x)  -  b)}  for  u  a  O.  Then  f(x  )  ■  $(v  ) 

eff(X)  'v*  *  *  * 

with  v*  -  u*(b^/bo)^+^"  for  1*1,...,  m.  However  since  £(x*)  a  and 


Theorem  5, 


-  b)  -  0  hold,  by  Leona  7.1  we  have  that  4>(v  )~mln  <fr(u).  Hence,  by 
^  uaO 

1  we  complete  the  proof. 


m 


8.  A  Sufficient  Condition  for  Assumption  (AX) 

In  this  section  (Al)  ~  (A4)  are  assumed,  and  we  will  show  that  the  strict 
local  concavity  at  x*  is  a  sufficient  condition  for  the  assumption  (AX). 


Definition  A  program  (P)  is  locally  concave  at  a  local  minimum  point  x,  if 
m 

JC(x)  ■  V2f(x)  +  Eu.V2g  (X)  is  negative  semidefinite  on  R  where  u  is  the 
1  J  3 

associated  Lagrange  multiplier  of  x.  (P)  is  locally  strictly  concave  at  x  if 
£(x)  is  negative  definite  on  Rn . 


;</v 
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Lemma  8.1 

If  <£(x  )  la  negative  (semi)definite  on  Rn,  then  7Uj(bj)  is  positive 
(semi) definite  on  rJJL 

proof  For  any  s  £  R^,  we  have 


s^UjO^s-  (s^xCbjJVgjCx*))  7uJ(bJ)s  by  (2.2) 

-  sT7x(bJ)(-.X(x*)  Vx(bj)T)s  by  (2.1) 

-  -(7x(bJ)T8)T^(x*)(7x(bJ)T8) 

Hence  7uj(bj)  Is  positive  (seml)deflnite  on  if  and  only  if  «f(x*)  is 

negative  (semi) definite  on  Im  7x(bj),  because  by  (2.2)  7x(bj)  has  full  rank. 

Since  JC(x  )  is  negative  (semi)definite  on  Rn,  it  follows  that  7u  (b  )  ia 

J  J 

positive  (semi)definlte  on  R^JL 


QED 


By  the  assumption  (A4)  and  by  (2,3),  we  have  72w  (bT)  -  -7u  (b  ) . 

J  J  J  «J 

Hence  Lemma  8.1  implies  that  Wj(y^)  is  strictly  concave  in  a  neighborhood  of 
bj  if  (P)  is  locally  strictly  concave  at  x  .  So  we  obtain 


Proposition  8.2  Assume  (Al)  ~  (A4)  are  satisfied. 


If  (P)  is  locally  strictly  concave  at  x  ,  then  the  assumption  (AX)  holds 


>roof 


Let  N  be  a  convex  neighborhood  of  bj  in  Rj^Jsuch  that  w^C.)  is  strictly 
concave  on  N  by  Lemma  8.1.  Then  M:  ■  { (y  ,y.)€  0 ^  I  wT(yT)  >  y  ,  yT  €  N> 

O  J  TT  J  %J  O  J 


d 
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1  lJ  ' 

is  a  convex  set.  Let  U:  •  R^  *N.  Then  U  O  {(yQ,yj)  t  R|  (°  |wj(7j)>  ■  M. 

*  * 

By  remark  4.8,  for  any  q  >  -1,  (y  ,yT)  attains  a  strict  local  maxima  of  F 

lJQl  ° 

on  {(y„,yT)fc  Rj.  |w.(yT)  *  y  }.  Hence,  it  is  also  a  strict  local  maximum  of 

O  J  TT  J  J  O 

F  on  the  smaller  domain  M.  However,  since  F  is  a  strict  concave  function 

q  q 

and  since  M  is  a  convex  set,  (yo,yj)  is  a  unique  global  maxima  of  F^  on  M. 

*  *  I JQ ^ 

Namely,  we  have  shown  that  for  the  neighborhood  U  of  (y  ,y  )  la  >. .  we  have 


that  for  any  q  J  -1  and  for  any 


- - -  —  V - +*■ 

<VyJ)4  un  R  ^  »  y„l> 


f,<y0,yj)  <  F,<y‘.yj) 


holds  where  equality  holds  only  if  (y  ,yT)  -  (y  ,y.) 

0*1  O  J 


9.  Optimum  Value  Function  with  A  Quadratic  Term 


In  this  last  section  a  parametrized  quadratic  term  is  considered.  We 
subtract  a  quadratic  term  from  the  optimum  value  function  and  we  will  derive 
the  modified  global  duality  theorem  without  the  assuaption  (AX).  Throughout 
this  section  (Al) (A4)  are  assumed  as  usual. 

For  y  )  0,  y€Rm,  yjfe  R^J^  we  define 

wY(y):  -  w(y)  -  y| |y-b| |2 

'  Yllyj-bjH2 

where  ||y-bl|2  -  E  (y^-b^)2  and  llyj-bj||2  -  E  (y^-b^)2. 

1  J 

Let  TY  :  R®fl— *>  R®4”1  be  defined  by  TY(yQ,y):  -  (y^-yf  |y-b|  j2,  y)  for  y  >  0. 

Y  ml  1 

It  is  easily  verfled  that  T'  gives  a  homeomorphlsm  of  R  and  maps 


I 
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i 


i 

¥ 

'f 

i' 


{(y  ,y)  I  w(y)  >  y  }  homeomo rphlcally  onto  {(y  ,y)  I  wY(y)  >  y  }  .  Let  us  define 
0*0  o  o 

effY(K):  -  TY (eff (K)) 

effY(X)»  -  {xARn  |  (f  (x) ,g(x) )  €  ®f fY (K) }  . 

Slues  TY  Is  coutlnuous  effY(K)  Is  compact  by  (A3). 

Lse  us  consider  s  prograa 

(9.1)  asx  {f  (y  ,y.)  *ubJ«ct  to  wY(y  )  >  y_> 

|j  |  q  o  J  j  j  o 

for  soas  q  A  -1  sad  y  >  0.  Then  *e  hm 
Ls—s  9.2  (local  support) 

In  the  program  (9.1),  for  sufficiently  largo  Y.  there  exists  a  neighbor- 

Y  A  A  I  ^  o  ^  V 

hood  U'  of  (yo,yj)  in  such  that  for  any  q  )-l  and  any  (yQ,yj)  €U*  n 

{(y0.yj)  I  *  y0>.  w* 

Fq(yo.yj)  «  Fq(y^y*) 

where  equality  holds  only  If  (yQ,yj)  ■  (y^y*) 


proof  For  conputatlonal  convenience,  we  consider  e  prograa 


(9.3) 


R 


“*  tGffl(y«»yj)  ■«*J«ct  to  wY(y  )  >  y  } 
|Jo|  9  °  J  J  J  o 


where  Cq(yQ,yj)  -  log  Fq(yo,yj)  as  before. 

Since  we  have  VwY(bj)  ■  Vw  ,(fc?) ,  the  entire  proof  of  Proposition  4.5  is  applied. 

A  A 

So  we  obtain  that  (y„,yT)  satisfies  the  Kuhn- Tucker  conditions  with  the  Lagrange 

O  J 
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multiplier  v  ■  (u*^b)  which  does  not  depend  on  y  end  q.  Note  thet  VS^Cbj) 
ie  negetive  definite  for  sufficiently  lerge  y,  because  VS^Cbj)  «  ^Hr^Cbj) 

-  2yl|j|.  Therefore,  by  Remark  4.8  (y*,y*)  satisfies  the  second  order  suffi¬ 
cient  conditions  for  (9.3)  for  sufficiently  large  y.  Hence  by  Proposition  8.2 
we  complete  the  proof. 

QEP 

Lama  9.4  (global  support) 


Then  for  sufficiently  large  q  and  for  any  (yQ,y)6  effY(K),  we  have 


Fq(y0.y>  <  VV?*) 


where  equality  holds  only  if  (70tyj)  "  (yQ»yj)» 


Y  *  * 

He  separate  this  proof  into  two  part:  a  neighborhood  V'  of  (yQ,y  )  and 
outside  this  neighborhood  effY(K)  -  VY.  The  proof  of  the  last  part  is  exactly 
the  same  as  the  one  in  Theorem  5.1.  So  we  will  prove  the  first  part.  Let  us 
define 

Y  Y  lIVol  ,  Y 

vY;  -  (u^R^  )n((y0,y)  |  wY(y)  >  yQ}  . 

(yj.y1)*  Vy  — *  wY(yJ)  -  Wj(yJ)  -  y||yj  -  bj  |2  >  w(yX)  -  y|  (y1  -  b||2 
•  wY(y1)  i  y*  because  Wj(y*)  *  "(y1)  and  | ly1  -  b| |2  >  j |yj  -  bj| |2. 

(yi»yi)€uYn{(y0,yJ)  I  ^(7j)  >  y0>  ==>  Fq(yJ,yJ)  4  Fq(y*,y*)  =* 

F  (y1*yl)  <  F  (y*,y*)  for  q  >  -1  and  equality  holds  only  if  (y*,yb  “  <yrt»yr>* 

q  O  <1  O  o  J  w  j 

QEP 


Theorem  9.5 


Let  Y  *  0  be  sufficiently  large  such  that  V^jCbj)  la  negative  definite, 
Then  under  the  assumptions  (Al)  -  (A4),  for  sufficiently  large  q  we  have 


f(x*)  ■  min 
At  u)o 


max  {f(x)  +  uT(g(x)  -  b)} 
effY(X)  *  * 


If  we  replace  eff(K)  and  eff(K),  respectively,  by  eff^(K)  and  eff^CK), 
then  the  proof  of  this  theorem  follows  exactly  from  the  proof  of  Theorem  7.4, 

QEJ 
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